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PROCESS AND DEVICE FOR DE-INTERLACING BY PIXEL ANALYSIS 

Cross-Reference To Related Applications 

[0001] This application is based upon and claims priority from prior French Patent 
Application No. 03 02013, filed on February 19, 2003 the entire disclosure of which is 
herein incorporated by reference. 

Field of the Invention 

[0002] The present invention generally relates to a de-interlacing process and device, 
more particularly for adapting signals consisting of interlaced fields to so-called 
progressive scanning systems. 

Background of the Invention 

[0003] It will be remembered that a conventional video image is constituted, in respect of 
each image, by two fields, known as an even-numbered field and an odd-numbered 
field, which are interlaced on alternate lines. At display, these fields are scanned 
successively in time on the screen, typically a cathode ray tube, with the lines of the 
second field of an image being scanned on the spaces left between the scanning lines 
of the first field. Relative to a progressive scanning, where the successive lines of a 
complete image are displayed sequentially, interlaced frame scanning makes it possible, 
on the one hand to double the vertical resolution while retaining the same pass band or, 
at equal vertical resolution to double the frame return frequency and thereby to reduce 
the effects of flickering. 

[0004] Analog and digital video signals are generally formatted in the form of interlaced 
frames, known as "interlaced video". Systems need therefore to be provided that convert 
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interlaced video signals into non-interlaced video when it is necessary to display them in 
progressive scanning mode. The latter is used particularly in addressable line-by-line 
display devices such as plasma panels, liquid crystal displays, organic light-emitting 
diodes, etc. that use an electrode matrix network for example. 

[0005] Systems of this kind, known as "de-interlacing" systems, must produce all the 
displayed lines of an image from only one field of the two fields of which it consists. In 
fact, since a field contains only one line in two of the image, de-interlacing calls on 
interpolation techniques that allow the content of the missing lines to be determined on 
the basis of the content of their adjacent lines and where appropriate the adjacent fields. 

[0006] Conventionally, the interpolated output of the de-interlaced signal is constituted 
from a spatial interpolation and a temporal interpolation according to a variable 
weighting. The contribution of each of these two interpolations in the composition is 
generally variable over a range including the two extreme situations, namely 100% 
spatial interpolation and 100% temporal interpolation respectively. The decision in 
question therefore consists in determining the respective spatial and temporal 
interpolation weightings in the constitution of the interpolated output signal. This 
determination is made by a mixer, more generally known as a "fader, which receives 
the two types of interpolation at input and produces the interpolated signal at output with 
the aforementioned weightings. 

[0007] In basic interlacing, the missing lines are in most cases interpolated by low-pass 
spatial filtering of the existing adjacent lines. A field fusion technique is used when the 
medium is a film, since it is then known that an odd-numbered field followed by the 
corresponding even-numbered field are connected at the same temporal position or that 
an even-numbered field followed by the corresponding odd-numbered field are 
connected at the same temporal position, the film detection systems allowing one or 
other of the situations to be identified. In a more general way, temporal interpolation 
may be used in the case of a fixed image. This gives the advantage of avoiding 
unnecessary losses of definition caused by low-pass spatial filtering. 
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[0008] In most de-interlacing systems that use both temporal interpolation and spatial 
interpolation, a decision is made once per field, generally taking the safest option, based 
on a film detection. 

[0009] This implies that time domain filtering is used only if the whole image is detected 
as being static. This often leads to switching artifacts, where the image has a high level 
of sharpness when everything is motionless, but loses it as soon as motion appears. 

[0010] Furthermore, we are moving towards video contents that have static parts 
inserted into them, such as logos in moving images or scrolling text over a quasi-static 
image. In this case, it is desirable to use an interpolation that is more spatial in some 
parts of the image and an interpolation that is more temporal in others. There are also 
sources where some parts of the image have a video content whereas other parts come 
from a film. 

[001 1] The result is that in all de-interlacing systems requiring a film detection, the de- 
interlacing is not optimum for the whole image. 

[0012] Sophisticated motion compensation de-interlacing systems also suffer from this 
last limitation. 

[0013] Accordingly, a need exists for a low-cost de-interlacing system that overcomes 
the limitations of the prior art and which does not require a high level of performance at 
medium detection system level, whatever the medium may be (film, video, or a mixture 
of the two) 

Summary of the Invention 

[0014] The present provides a de-interlacing which does not require a high level of 
performance at medium detection system level, whatever the medium may be (film, 
video, or a mixture of the two). Implementing the present invention is also much less 
costly than sophisticated motion compensation solutions, also based on a detection of 
the medium. 
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[0015] More particularly, the invention present invention is a process for de-interlacing a 
video signal, wherein a signal is produced at output of video images de-interlaced by 
interpolating the pixels missing from the interlaced video signal presented at input, 
interpolation on the output signal being made up selectively of a spatial interpolation and 
a temporal interpolation with a decision being made on the variable degree of presence 
of spatial interpolation and/or of temporal interpolation in said output signal, said 
decision being made as a function of a detection of motion in the relevant area of the 
image, 

[0016] characterized in that said decision is made additionally as a function of a 
detection of the detail in a relevant area of the image. 

[0017] To advantage, the decision is made for each individual interpolated pixel. 

[0018] In the preferred embodiment, the spatial interpolation is made on the basis of a 
determination of the direction, among a series of directions under consideration 
connecting pixels on different lines of a given pixel window, for which the minimum 
difference is obtained between the values of the pixels on the different lines so 
connected along this direction, where one of the directions under consideration 
corresponds to an angle of approximately 26° and/or an angle of approximately 63° 
relative to the vertical, for a geometry with a pixel pitch that is equal in the vertical and 
horizontal directions. 

[0019] To advantage, the spatial interpolation is made on the basis of a determination of 
the direction, among a series of directions under consideration connecting pixels on 
different lines of a given pixel window, for which the minimum difference is obtained 
between the values of the pixels on the different lines so connected along this direction, 
where, when there are several directions producing the same minimum difference 
between the values of the pixels so connected, the vertical direction or, where 
appropriate, the direction closest to the vertical direction is selected. 

[0020] The spatial interpretation may be made on the basis of a determination of the 
direction, among a series of directions under consideration connecting pixels on 
different lines of a given pixel window, for which the minimum difference is obtained 
between the values of the pixels on the different lines so connected along this direction, 
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where, when there are two diametrically opposed symmetrical directions producing the 
same minimum difference between the values of the pixels so connected, and arranging 
things so that neither of the two directions is closer to the vertical direction than the 
other, the vertical direction is selected instead. 

[0021] The spatial interpolation may be made on the basis of an averaging of pixel 
values, where the same pixel positions are taken to determine both the averaging of the 
luma component of the interlaced input video signal and the averaging of the chroma 
component insofar as the same pixels are available for the two components. 

[0022] The spatial interpolation may be made on the basis of a determination of the 
direction, among a series of directions under consideration connecting pixels on 
different lines of a given pixel window, for which the minimum difference is obtained 
between the values of the pixels on the different lines so connected along this direction, 
where the determination is made on the luma component of the interlaced input video 
signal, and in that the direction so determined is also used as the interpolation direction 
for the chroma component of this video signal. 

[0023] To advantage, motion is detected, for a given pixel, by a recursive calculation 
implementing a motion value intermediate value loop with attenuation by a factor FA of 
less than 1 . 

[0024] Preferably, the motion value M is determined for a pixel for interpolation X of a 
field m by application of the following algorithm: 

[0025] M0=max(|A-D|,FA*M(N)) 

[0026]Mp=min(M(N1),M(N1+1» 

[0027] M=max(M0,Mp): 

[0028] where: 

[0029] A is the pixel in the same position as the pixel X, but in the field m+1 , 
[0030] D is the pixel in the same position as the pixel X, but in the field m-1 , 
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[0031] M(N) equates to the value MO calculated one frame before, i.e. N lines before, 
with N being the total number of lines in the image. 

[0032] M(N1 ) equates to the value MO calculated N1 lines before, where 

[0033] N1 = (N-1)/2 in the event of N being odd-numbered 

[0034] N1 = (N-2)/2 in the event of N being even-numbered and the luma lines for 
interpolation being the 2 nd , 4 th etc. lines in the image, 

[0035] N1 = N/2 in the event of N being even-numbered and the luma lines for 
interpolation being the 1 st , 3 rd etc. lines in the image, 

[0036] M(N1+1) equates to the value M0 calculated (N+1) lines before, and 

[0037] FA is the attenuation factor. 

[0038] Preferably, the attenuation factor FA is equal to 15/16. 

[0039] The weighting may be determined on the basis of the luma component of the 
video signal. 

[0040] The interpolation determined on the luma component of the video signal is 
obtained by the following algorithm: 

[0041] I = med(s,t+M,t-M) if M<d 

[0042] otherwise l=s 

[0043] where I represents the final interpolation 
[0044] s represents spatial interpolation, 
[0045] t represents temporal interpolation, 

[0046] M represents the measurement of motion at the interpolation position, 
[0047] d represents the measurement of detail at the interpolation position, and 
[0048] med (a,b,c) represents the median function of a, b, c. 
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[0049] The selection made on the basis of the luma component of the signal can also be 
applied to the chroma component. 

[0050] Preferably: 

[0051] i) in the event of the final interpolation on the luma being closer to the temporal 
interpolation, the final interpolation of the chroma is the temporal interpolation; and/or 

[0052] ii) in the event of the final interpolation on the luma being closer to the spatial 
interpolation, the final interpolation of the chroma is the spatial interpolation; and/or 

[0053] iii) when the spatial and temporal interpolations have an equal contribution in the 
final interpolation of the luma, the spatial and temporal interpolations have an equal 
contribution in the final interpolation of the chroma. 

[0054] According to a second embodiment, the invention provides a device for de- 
interlacing a video signal, producing at output a signal of video images de-interlaced by 
interpolating the pixels missing from the interlaced video signal presented at input (E), 
the device including means to carry out the interpolation on said output signal by 
selective composition from a spatial interpolation and a temporal interpolation with a 
decision being made on the variable degree of presence of spatial interpolation and/or 
temporal interpolation in said output signal, these means making said decision as a 
function of a detection of motion in the relevant area of the image, 

[0055] characterized in that the means make said decision additionally as a function of a 
detection of the detail in a relevant area of the image. 

[0056] The means cited may determine the weighting for each individual interpolated 
pixel. 

[0057] The aforementioned device may include programmed means for carrying out the 
process according to the first embodiment. 

[0058] According to a third embodiment, the present invention provides a video display 
device with display by sequential scanning able to function from interlaced input video 
signals, characterized in that it includes a device according to the second embodiment 
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so as to bring about the de-interlacing that allows sequential scanning signals to be 
obtained. 

Brief Description of the Drawings 

[0059] The subject matter, which is regarded as the invention, is particularly pointed out 
and distinctly claimed in the claims at the conclusion of the specification. The foregoing 
and other features, and advantages of the invention will be apparent from the following 
detailed description taken in conjunction with the accompanying drawings in which: 

[0060] FIG. 1 is a system diagram of a de-interlacing system in accordance with the 
invention; 

[0061] FIG. 2 is a representation of pixels over three lines and covering three successive 
fields involved in temporal interpolation in accordance with the invention; 

[0062] FIG. 3 is a representation of pixels on a window of three lines and five columns of 
one and the same field involved in spatial interpolation in accordance with the invention; 

[0063] FIGs. 4a to 4g each resume the representation in FIG. 3 by showing respectively 
a direction of possible spatial interpolation, namely: vertical (FIG. 4a), diagonal at +26°, 
diagonal at +45° (FIG. 4b), diagonal at +63° (FIG. 4c), diagonal at -26° (FIG. 4d), 
diagonal at -45° (4e), and diagonal at -63° (FIG. 4g); 

[0064] FIG. 5 is a representation of pixels over three lines and covering five successive 
fields involved in the detection of motion in accordance with the invention; and 

[0065] FIG. 6 is a system diagram of the elements that allow application of a motion 
detection algorithm in accordance with the present invention. 
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Description Of The Preferred Embodiments 

[0066] It should be understood that these embodiments are only examples of the many 
advantageous uses of the innovative teachings herein. In general, statements made in 
the specification of the present application do not necessarily limit any of the various 
claimed inventions. Moreover, some statements may apply to some inventive features 
but not to others. In general, unless otherwise indicated, singular elements may be in 
the plural and vice versa with no loss of generality. 

[0067] A block diagram of the de-interlacing system 1 according to the preferred 
embodiment of the invention is given in FIG. 1. 

[0068] This system 1 accepts at input E the successive fields of an interlaced video 
signal, each field corresponding to a video half image while containing one line in two 
alternately over the whole image. At output S, the system produces, for each input field, 
a complete video image by filling in the lines missing from the field using an interpolation 
technique. This interpolation technique may use information coming from several 
successive fields, particularly from the previous field and from the successive field. This 
may involve a period of time equal to a field in the output, but the rate of one complete 
output video image per field presented at input is retained nonetheless. The output 
signal S can thus be used on a progressive scanning screen, such as a plasma panel, a 
liquid crystal display, and other matrix display devices, as well as some types of cathode 
ray tube specially designed for this type of scanning. 

[0069] At system level, the interlaced video fields presented at the input E of the system 
are transmitted simultaneously with and in parallel to four units: 

[0070] - a detail detection unit 2, 

[0071] - a motion detection unit 4, 

[0072] - a spatial interpolation unit 6, and 

[0073] - a temporal interpolation unit 8. 
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[0074] The outputs of these four units 2-8 are presented at input of an interpolation 
selection unit 10, also known as a mixer or "fader" which produces at its output S the de- 
interlaced signal Sde of the system 1 for exploitation. 

[0075] The interpolation selection unit 10 produces its output signal S from the spatial 
and temporal interpolations at its inputs. More particularly, this output signal is of 
variable composition over a range from 100% spatial interpolation to 100% temporal 
interpolation, the contribution of each of these component parts being fixed by weighting 
coefficients Ps and Pt for the spatial and temporal interpolations respectively. By playing 
on these coefficients, the selection unit is able to produce interpolation mixes between 
these two extremes, hence the designation mixer. To determine the weightings - and 
therefore the rate of mix of the two interpolations in the output signal - the unit evaluates 
for the relevant image pixel not only the information about motion as supplied by the 
motion detection unit 4, but also information about the detail, as supplied by the detail 
detection unit 2. 

[0076] The weighting coefficients between the spatial and temporal interpolations can be 
established from the median formula: 

[0077] med (t-M, t+M, s), where t and s are respectively the values of the temporal and 
spatial interpolations and M the motion measurement value. 

[0078] These formulae are well-known to those of average skill in the art and will not be 
analyzed here in the interests of conciseness. 

[0079] In practice, a median filter can be set up that is low-cost in hardware terms, 
whereas accurate calculation of the weighting coefficients followed by their application 
so as to calculate the final interpolation is generally more expensive. 

[0080] In the same way, to determine which weighting shall predominate, the calculated 
final interpolation value is used and the difference between this interpolation and the 
spatial interpolation on one hand and the difference between this final interpolation and 
the temporal interpolation on the other hand are compared directly. 

[0081] The interpolation selection unit 10 is capable of switching - in other words 
selecting the weightings - at each pixel of the signal, thus giving the possibility of 
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* choosing the most adapted composition of output interpolation for each individual 
interpolated pixel. 

[0082] In the preferred embodiment of the system 1 : 

[0083] - the spatial interpolation unit 6 operates by detecting transitions, in association 
with a spatial reliability. The advantage of this system is that the spatial reliability comes 
naturally from the transition detection itself; 

[0084] - the motion detection unit 4 takes account of the perceptual dynamic effects of 
local motion changes in a scene. Compared with other systems, motion detection is 
provided to give, in combination with spatial reliability and pixel-based decision-making, 
the best compromise between vertical resolution and performance variation in the event 
of local motion changes; and 

[0085] - the selection (or decision) unit 10 applies fuzzy logic at the level of each pixel, 
which takes account of spatial reliability and motion detection to control an output 
selection switch between spatial and temporal interpolation. The advantage of the 
system is that it is robust in respect of erroneous motion detection, such as can 
particularly occur during fast text scrolling. Pixel-based decision-making allows the best 
de-interlacing performances to be obtained at local level, whatever the source medium 
(video, film, or mixture). 

[0086] An important purpose sought in transferring from an interlaced video content to a 
progressive medium is the elimination of artifacts such as flickering, or "line crawling", 
which are inherent in an interlaced scanning system. 

[0087] The suggested algorithm does not require film detection. Indeed, combining 
directional spatial interpolation and temporal interpolation, controlled by pixel-based 
decisions, allows locally optimized de-interlacing to be obtained. 

[0088] Another weak point of existing systems of adaptive pixel-based de-interlacing is 
that they produce decisions based on motion estimation alone. In that way, they 
acknowledge their limitations as soon as motion estimation is caught out, which occurs 
particularly during fast text scrolling, causing artifacts that are very hard to endure. 
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[0089] The system in accordance with the invention does not suffer from a limitation of 
this kind thanks to its pixel-based decision-making capacity, which uses both motion 
estimation and the reliability of spatial interpolation. 

[0090] The reliability of spatial interpolation is taken as read in spatial interpolation since 
it is derived directly from transition detection. 

[0091] The algorithm according to the invention is also remarkable, relative to 
conventional interlacing systems that use a motion estimator, in that the latter, in the 
case of the invention, takes account of the dynamic perception effects of motion 
changes. In combination with pixel-based decision-making, the algorithm according to 
the invention ensures that no switching artifacts can appear in the image when an object 
starts to move or ceases to move in the image. 

[0092] Video formats 

[0093] The de-interlacing system according to the invention is able to manage the YUV 
4:2:2 and YUV 4:2:0 formats derived from the YCRCB digital standard. In principle, the 
system could be applied to YUV sources 4:4:4, but these YUV sources are generally 
thought of as exceptional, and generally cannot be managed by the processing blocks 
which traditionally follow a de-interlacing. The present de-interlacing system does not 
modify the format. The component parts U and V are co-situate and are always subject 
to the same processing relative to each other. From now on the component UV will thus 
be designated jointly and severally, rather than separate reference being made to 
component parts U and V. 

[0094] Hereinafter, the following designations are used: 

[0095] - m is the field number. Odd-numbered values of m correspond to the fields 
including the 1st, 3 rd etc. lines of the whole image and even-numbered values of m 
correspond to fields including the 2nd, 4th etc. lines of the whole image; 

[0096] - the line number is n starting with 1 at the top of the image, up to the total 
number of lines in the complete frame. In odd-numbered fields, Y is defined only for 
odd-numbered values of n; in even-numbered fields, Y is defined only for even- 
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numbered values of n. The de-interlacing system interpolates on the even-numbered 
lines of odd-numbered fields and on the odd-numbered lines of even-numbered fields; 

[0097] - the column position is given by a number k starting with 1 for the pixel located 
furthest left. It is assumed that k is an even number. 

[0098] For 4:2:2 inputs, 

[0099] - in the odd-numbered fields: UV is defined for each odd-numbered n and for 
each odd-numbered k, and 

[0100] - in the even-numbered fields: UV is defined for each even-numbered n and each 
odd-numbered k. 

[0101] The de-interlacing system interpolates UV, 

[0102] - in the odd-numbered fields: for each even-numbered n and each odd-numbered 
k in the odd-numbered fields and 

[0103] - in the even-numbered fields: for each odd-numbered n and each odd-numbered 
k. 

[0104] For 4:2:0 inputs, 

[0105] - in the odd-numbered fields: UV is defined for n = 1 , 5, 9, etc and for each odd- 
numbered k, and 

[0106] - in the even-numbered fields, UV is defined for n = 3, 7, 1 1 and for each odd- 
numbered k. 

[0107] The de-interlacing system interpolates UV: 

[0108] - in the odd-numbered fields: for n = 3, 7, 1 1, etc and each odd-numbered k, and 

[0109] - in the even-numbered fields: for n = 1 , 5, 9 and each odd-numbered k. 

[01 10] The original lines are kept without modification: only the missing lines are 
interpolated. This makes it possible to retain the field structure throughout processing, 
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and to change to a frame structure only at the output of the de-interlacer. It will be 
noticed that in algorithms using polyphase filters, such as those typically used in zoom 
algorithms, the original lines are also modified. 

[0111] The fact of using the image detail as one of the interpolation selection criteria is 
advantageous when set against selection techniques based on the single criterion of 
motion detection, since it allows any failures in motion detection to be made good. 

[01 12] For each pixel, an estimate is made of: 

[0113] - the value the pixel would assume if it was fully interpolated spatially, 

[01 14] - the value that the pixel would assume if it was fully interpolated temporally, 

[01 15] - the reliability of spatial interpolation in detail detection, and 

[0116] - the reliability of temporal interpolation in motion detection. 

[01 17] In the output selection block, the two aforementioned reliabilities are compared in 
order to control the fuzzy switching which mixes the two interpolations in order to 
produce the final output value. 

[00100] Temporal interpolation 

[01 18] The principle of temporal interpolation is shown in FIG. 2. 

[0119] The interpolation of the missing pixel X is t= (A+D)/2, where A and D are the 
pixels in the same position in the next field and the previous field respectively. Temporal 
interpolation introduces a delay equal to a field in the system. 

[0120] For the luma Y, this formula is valid for any even-numbered k and any even- 
numbered n in the odd-numbered fields, and for any odd-numbered k and any odd- 
numbered n in the even-numbered fields. 

[0121] For 4:2:2 chromas, the formula is valid for any odd-numbered k and any even- 
numbered n in the odd-numbered fields, and for any odd-numbered k and any odd- 
numbered n in the even-numbered fields. 
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[0122] For 4:2:0 chromas, the formula is valid for any odd-numbered k and n= 3,7,1 1, 
etc in the odd-numbered fields, and for any odd-numbered k and n=1 ,5,9, etc in the 
even-numbered fields. 

[0 1 23] Spatial interpolation 

[0124] Spatial interpolation consists in seeking the best direction for the interpolation, 
this search being carried out within a window of 5*3 pixels, as is shown in FIG. 3. 

[0125] The approach consists in seeking the direction for which modifications between 
the line n-1 and the line n+1 are minimal. 

[0126] By way of example, if the differences between the pixels at positions (n-1 , k-2) 
and (n+1 ,k-2), (n-1 ,k-1 ) and (n+1 ,k-1 ), (n-1 ,k) and (n+1 ,k), (n-1 ,k+1 ) and (n+1 ,k+1 ), (n- 
1 ,k+2) and (n+1 ,k+2) tend to be larger than the differences between the pixels at 
positions (n-1 ,k) and (n+1 ,k-2), (n-1 ,k+1 ) and (n+1 ,k-1 ), (n-1 ,k+2) and (n+1 ,k), it will 
therefore appear more logical to interpolate the missing pixel at position (n,k) as the 
mean of the pixels at positions (n-1 ,k+1 ) and (n+1 ,k-1 ), rather than to consider the pixels 
at positions (n-1,k) and (n+1,k). 

[0127] The window of 5*3 pixels allows the search to be carried out in the vertical 
direction and in three diagonal directions on each side. 

[0128] For each direction K, the weighted sum of absolute differences SAD(K) is 
calculated: 

[0129] - vertical direction (K=0), cf. FIG. 4a: 

[01 30] SAD(0)=0. 125*| Y(n-1 ,k-1 )-Y(n+1 ,k-1 |+0.75*|Y(n-1 ,k)-Y(n+1 ,k|+0.25*|Y(n-1 ,k+1 )- 
Y(n+1,k+1)|. 

[0131] - diagonal direction at 26° (K=1), cf. FIG. 4b: 

[01 32] SAD(1 )=0. 1 875*|Y(n-1 ,k-1 )-Y(n+1 ,k-2)|+0.31 25*| Y(n-1 ,k)-Y(n+1 ,k- 
1 )|+0.31 25*|Y(n-1 ,k+1 )-Y(n+1 ,k)|+0.1 875*|Y(n-1 ,k+2)-Y(n+1 ,k+1 )|. 

[0133] - diagonal direction at 45° (K=2), cf. FIG. 4c: 
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[0134] SAD(2)=0.3125*|Y(n-1 ,k)-Y(n+1 ,k-2)|+0.375*|Y(n-1 ,k+1 )-Y(n+1 ,k- 
1 )|+0.3125*|Y(n-1 ,k+2)-Y(n+1 ,k)|. 

[0135] - diagonal direction at 63° (K=3), cf. FIG. 4d: 

[0136] SAD(3)=|Y(n-1 ,k+2)-Y(n+1 ,k-2)|. 

[0137] - diagonal direction at -26° (K=-1), cf. FIG. 4e: 

[01 38] SAD(-1 )=0.1 875*|Y(n+1 ,k-1 )-Y(n-1 ,k-2)|+0.31 25*|Y(n+1 ,k)-Y(n-1 ,k- 
1 )|+0.3125*|Y(n+1 ,k+1 )-Y(n-1 ,k)|+0.1 875*|Y(n+1 ,k+2)-Y(n-1 ,k+1 )|. 

[0139] - diagonal direction at -45° (K=-2), cf. FIG. 4f: 

[0140] SAD(-2)=0.3125*|Y(n+1 ,k)-Y(n-1 ,k-2)|+0.375*|Y(n+1 ,k+1)-Y(n-1 ,k- 
1 )|+0.31 25*|Y(n+1 ,k+2)-Y(n-1 ,k)|. 

[0141] - diagonal direction at -63° (K=-3), cf. FIG. 4g: 

[0142] SAD(-3)=|Y(n+1 ,k+2)-Y(n-1 ,k-2)|. 

[0143] The best direction for interpolation is the one that corresponds to the minimum 
SAD value. 

[0144] The search is conducted for the component Y alone. The best direction found is 
then also applied in respect of the spatial interpolation of the chroma, as follows: 

[0145] - for a 4:2:2 chroma at a given position (n,k), the decision made for the luma at 
the position (n,k) is applied; 

[0146] - for a 4:2:0 chroma, UV is not co-situate with the luma Y. At a given position, the 
decision made for the closest luma sample is applied, i.e. just beneath in the odd- 
numbered field, or just above in the even-numbered field. 

[0147] The advantage of having an independent best direction search for the chroma is 
limited: 
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[0148] - the chroma inputs are only available for odd-numbered values of k. It therefore 
becomes difficult to determine accurately which of the directions, of the vertical at ±63° 
is the best: 

[0149] - the main benefit of directional interpolation is at transition level. In fact in natural 
video images, the chroma transitions most often correspond to the positions of the luma 
transitions; 

[0150] - the attenuation decision is at all events based on the luma component, since it 
is quite unrealistic to obtain a motion detection on the basis of the chroma. 

[0151] The spatial interpolations Ys and UVs are defined as follows: 



[0152] 


For the luma Y: 




[0153] 


If min(SAD)=SAD(0) then Ys1 = 


=(Y(n-1,k)+Y(n+1,k)/2 


[0154] 


If min(SAD)=SAD(1 ) then Ys1 = 


=(Y(n-1 ,k)+Y(n+1 ,k-1 )+Y(n-1 ,k+1 )+Y(n+1 ,k))/4 


[0155] 


If min(SAD)=SAD(2) then Ys1 = 


=(Y(n-1,k+1)+Y(n+1,k-1))/2 


[0156] 


If min(SAD)=SAD(3) then Ys1 = 


=(Y(n-1 ,k+2)+Y(n+1 ,k-2))/2 


[0157] 


If min(SAD)=SAD(-1 ) then Ys1 


=(Y(n-1 ,k-1 )+Y(n+1 ,k)+Y(n-1 ,k)+Y(n+1 ,k+1 ))/4 


[0158] 


If min(SAD)=SAD(-2) then Ys1 


=(Y(n-1 ,k-1 )+Y(n+1 ,k+1 ))/2 


[0159] 


If min(SAD)=SAD(3) then Ys1 = 


=(Y(n-1 ,k-2)+Y(n+1 ,k+2))/2 



[0160] Finally Ys is given by: Ys=Ys1 if Ys1 is between Y(n-1,k) and Y(n+1,k), 
[0161] otherwise Ys=(Y(n-1 , k)+Y(n+ 1 ,k)/2 . 

[0162] The advantage of the last case is that it allows the occurrence of artifacts of 
discontinuities on subtle transitions to be averted. Such discontinuities are unpleasant, 
particularly in the presence of text scrolling. 
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[0163] The formula is valid for any even-numbered k and any even-numbered n in the 
odd-numbered fields, and for any odd-numbered k and any odd-numbered n in the 
even-numbered fields. 

[0 1 64] For the 4:2:2 chroma: 

[0165] If min (SAD)=SAD(0) then: 

[0166] Vs1=(UV(n-1,k)+UV(n+1,k))/2. 

[0167] If min (SAD )=SAD(1 ) then: 

[01 68] UVs1 =(3*UV(n-1 ),k)+UV(n+1 ,k-2)+UV(n-1 ,k+2)+3*UV(n+1 ,k))/8. 
[0169] If min (SAD)=SAD(2) then: 

[01 70] UVs=(UV(n-1 ,k)+UV(n-1 ,k+2)+UV(n+1 ,k-2)+UV(n+1 ,k))/4. 

[0171] If min (SAD)=SAD(3) then: 

[01 72] UVs1 =(UV(n-1 ,k+2)+UV(n+1 ,k-2))/2. 

[0173] If min (SAD)=SAD(-1)"then: 

[01 74] UVs1 =(UV(n-1 ),k-2)+3*UV(n+1 ,k)+3*UV(n-1 ,k)+UV(n+1 ,k+2))/8. 
[0175] If min (SAD)=SAD(-2) then: 

[01 76] Uvs1 =(UV(n-1 ,k-2)+UV(n-1 ,k)+UV(n+1 ,k)+UV(n+1 ,k+2))/4. 

[0177] If min (SAD)=SAD(-3) then: 

[01 78] UVs1 =(UV(n-1 ,k-2)+UV(n+1 ,k+2))/2. 

[0179] Finally Vs is given by: Uvs=Uvs1 if Uvs1 is between UV(n-1,k) and UV(n+1,k), 
[01 80] otherwise UVs=(UV(n-1 ,k)+UV(n+1 ,k))/2. 
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[0181] This formula is valid for any odd-numbered k and any even-numbered n in the 
odd-numbered fields, and for any odd-numbered k and any odd-numbered n in the 
even-numbered fields. 

[0 1 82] For the 4:2:0 chroma: 

[0183] By applying the decision made for the closest luma, we have: 

[0184] If min(SAD)=SAD(0) then UVs1=(UV(n-2,k)+UV(n+2,k)/2 

[01 85] If min(SAD)=SAD(1 ) then UVs1 =(UV(n-2,k)+UV(n+2,k-2)+UV(n- 
2,k+2)+UV(n+2,k))/4 

[0186] If min(SAD)=SAD(2) then UVs1=(UV(n-2,k+2)+UV(n+2,k-2))/2 

[0187] If min(SAD)=SAD(3) then UVs1=(UV(n-2,k+4)+UV(n+2,k-4))/2 

[0188] If min(SAD)=SAD(-1 ) then UVs1=(UV(n-2,k-2)+UV(n+2,k)+UV(n- 
2,k)+UV(n+2,k+2))/4 

[0189] If min(SAD)=SAD(-2) then UVs1=(UV(n-2,k-2)+UV(n+2,k+2))/2 
[0190] If min(SAD)=SAD(-3) then UVs1=(UV(n-2,k-4)+UV(n+2,k+4))/2. 
[0191] Finally UVs is given by: 

[0192] UVs=UVs1 if UVs1 is between UV(n-2,k) and UV(n+2,k), 
[0193] otherwise UVs=(UV(n-2,k)+UV(n+2,k)/2. 

[0194] This formula is valid for any odd-numbered k and n=3,7,1 1 etc. in the odd- 
numbered fields, and for any odd-numbered k and n=1,5,9 etc. in the even-numbered 
fields. 

[01 95] Case of multiple minima 

[0196] In the event of the presence of several equal minimum SAD values, the direction 
closest to the vertical direction is chosen. When two symmetrical directions (for example 
K=1 and K=-1 ) give the minimum SAD value, it may be considered that the calculation 
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of SAD does not allow a reliable selection of a dominant direction to obtained, and we 
revert to the vertical interpolation. 

[0 1 97] Choosing the window 

[0198] Choosing the size of the window equal to 5*3 (in pixels) secures a good 
compromise. By geometry, the width of the window limits the angle of interpolation (to 
63°). In practice, it appears that it is rarely useful to have a wider window to reconstruct 
diagonal transitions and that increasing the window is of very little help in reconstructing 
almost horizontal transitions. 

[0199] Tests with a window format of up to 19*3 pixels have been carried out. It then 
appears that the minimum SAD value rarely equates to an angle above 63°, even in 
cases of almost horizontal transitions. One explanation would be that for large angles, 
the pixels taken into account in calculating the SAD are remote from each other, with the 
result that the probability that they will give a minimum SAD is relatively small. On the 
other hand, interpolation carried out by averaging pixels that are remote from each other 
is quite risky. In fact, the system helps to eliminate most diagonal transition situations, 
but is not in a position to fully reconstruct quasi-horizontal transitions, even with a wide 
window. In particular, in the event of a quasi-perfect horizontal transition, no minimum 
SAD is found, and the safest choice is then to interpolate vertically (k=0). 

[0200] Nor does increasing the height of the window lead to an improvement in 
performance. The main reason for this is that if the definition of the SAD is simply 
extended over more lines, the system then searches for transitions with a fixed slope on 
several lines, and loses its capacity to reconstruct curved transitions. 

[0201] It will be remembered that directional interpolation produces its benefits 
especially on transitions. Within an object, the accuracy of the direction is less critical. If 
the object has no detail, then all the SADs will be close to 0 and any interpolation 
direction will be acceptable. If the object comprises numerous details or texture, it is 
important to avoid creating false correlations, between adjacent pixels, which might 
affect the uncertainty of the detail or the consistency of the texture. For these reasons, it 
is preferable to use a window of somewhat reduced dimensions. 
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[0202] Calculating SAD 



[0203] The choice of weightings given to all the absolute differences to calculate the 
SAD is not critical. However, it is desirable to give more weight to the difference 
between the pixels that are closest to the missing pixel. In practice, coefficients are 
chosen which are easy and inexpensive to implement in an integrated circuit. 

[0204] Choosing the interpolation direction 

[0205] The interpolation direction is simply chosen as the one that corresponds to the 
minimum SAD. In the case of multiple minima, the direction K is chosen that has the 
smallest absolute value. As an alternative, it is conceivable to include the values of all 
the pixels concerned in calculating the spatial interpolation. In practice, this approach is 
of limited interest, while it implements a more complex calculation. In the event of doubt, 
the safest direction is in the vertical direction, since it uses the pixels closest to the 
missing pixel. In the event of multiple minima, it turns out that the directions found are 
uniformly good (for example within an area devoid of details), and the choice is then 
immaterial. If the directions found are uniformly bad, it is probable that the temporal 
interpolation will be weaker and that the interpolation selection unit 10 will restrict any 
artifacts from erroneous spatial interpolation. 

[0206] Spatial interpolation reliability - measuring the detail. 

[0207] The minimum SAD also provides information about the reliability of the spatial 
interpolation, and can be used directly as a basic "detail measurement": the higher the 
detail measurement, the lower the degree of reliability. 

[0208] Another approach consists in defining the measurement of the detail d as the 
absolute difference between the two pixels used for the interpolation. In the case of |K|= 
1 , we take: 

[0209] - for K=1 , d=(|Y(n-1 ),k+1 )+Y(n-1 ,k)-Y(n+1 ,k)-Y(n+1 ,k-1 )|)/2. 
[021 0] - for k=-1 , d=(|Y(n-1 ),k-1 )+Y(n-1 ,k)+Y(n+1 ,k)-Y(n+1 ,k+1 )|)/2. 
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[021 1] The detail is measured only on Y, since the decision in respect of the 
interpolation selection unit 10 is made only for Y. 

[0212] A detail measurement is sought which is well in balance with the motion 
detection, so as to ensure the selection switch operates properly. The two 
aforementioned detail measurements satisfy this condition. 

[0213] It will be noted that the SAD is no longer an adequate detail measurement when 
the weightings given to all the absolute differences between the pixels that are closest to 
the missing pixel in the SAD are not higher than the others (particularly in the case of 
K=0). 

[02 1 4] Motion detection 

[0215] The first reason to use the interpolation selection unit 10 with choice of output 
between spatial interpolation and temporal interpolation is to guard against dynamic 
artifacts and to reduce the contribution of temporal interpolation if necessary. In practice, 
the loss of definition is considered as more acceptable for most observers. 

[0216] Attenuation is then controlled above all from a measurement of motion. The 
purpose of the measurement is to give a measure of the reliability of temporal 
interpolation. 

[0217] FIG. 5 shows a window of 3*5 pixels used to determine a motion D around a pixel 
X, located in the field m and at line n and in column k. This window occupies three lines: 
n-1, n and n+1 and five fields: m-3, m-2, m-1, m and m+1. 

[0218] In the expressions given below, the following designations are used: 

[0219] A = a pixel in the field m+1 , at line n and in column k 

[0220] B = a pixel in the field m, at line n+1 and in column k 

[0221] B1 = a pixel in the field m-2, at line n+1 and in column k 

[0222] D = a pixel in the field m-1 , at line n and in column k 



[0223] D1 = a pixel in the field m-3, at line n and in column k 
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[0224] C = a pixel in the field m, at line n-1 and in column k 

[0225] C1 = a pixel in the field m-2, at line n-1 and in column k. 

[0226] (The designations A, B, B1 , D, D1 , C, C1 correspond in fact to the values of the 
respective pixels.) 

[0227] In this approach, the motion around a pixel X may be considered as the median 
of the absolute differences |A-D|, |B-B1 1, |C-C1 1. In practice, however, safety comes first 
and the desire is for the interpolation selection unit to move more towards spatial 
interpolation as soon as temporal interpolation becomes too uncertain. 

[0228] This may be achieved by means of a maximum motion estimation around the 
pixel X: 

[0229]M=max(|A-D|,|D-D1|, median (|A-D|,|B-B1|,|C-C1|). 

[0230] What precedes may be formulated in an equivalent manner as follows: 

[0231] M0=max(|A-D|,|D-D1 1) 

[0232] Mp=min|B-B1 |,|C-C1 1) 

[0233] M=max(M0,Mp). 

[0234] One drawback of this implementation lies in the fact that it requires four field 
memories, whereas |D-D1|, |B-B1| and |C-C1| have previously been calculated in 
respect of evaluating motion for the previous fields. 

[0235] Another drawback is that the perceptive dynamic effects are not properly taken 
into account. In particular, when an object ceases to move, the motion measurement 
tends towards zero, the interpolation selection unit will suddenly move towards temporal 
interpolation, causing a sudden increase in resolution, which necessitates an ocular 
adjustment on the part of the observer. On the other hand, the system has to react 
rapidly when an object starts to move, even at the cost of a loss of resolution. 

[0236] The following recursive implementation is therefore proposed. 
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[0237] M0=max(|A-D|, FA*M(N)) 

[0238]Mp=min(M(N1),M(N1+1)) 
[0239] M=max(M0,Mp), 
[0240] where: 

[0241] A is the pixel in the same position as the pixel X, but in the field m+1 , 

[0242] D is the pixel in the same position as the pixel X, but in the field m-1 , 

[0243] M(N) equates to the value M0 calculated one frame before, i.e. N lines before, 
with N being the total number of lines, 

[0244] M(N1) equates to the value M0 calculated N1 lines before where N1= (N-1)/2 in 
the event of N being odd-numbered 

[0245] N1=(N-2)/2 in the event of N being even-numbered and where the luma lines for 
interpolation are the 2 nd , 4 th etc. lines of the image 

[0246] N1=N/2 in the event of N being even-numbered and where the luma lines for 
interpolation are the 1 st , 3 rd etc. lines of the image 

[0247] M(N+1) equates to the value M0 calculated (N1+1) lines before, and 

[0248] FA is the attenuation factor (15/16 as the default setting). 

[0249] FIG. 6 shows symbolically a system for measuring motion that allows this 
algorithm to be executed. At the input of this system is presented a pixel value A, in the 
event the pixel of same designation on the window shown in FIG. 5 in field m+1 and at 
line n. The pixel designated X, belonging to the same line n but in the field m, 
corresponds to the pixel for which the motion is being estimated. It is noted that the pixel 
A exists at the level of the interlaced input signal, whereas the pixel X, located at the 
same location but on the previous field, is absent from the input signal, and its value 
must be interpolated. 

[0250] The pixel A is subject to a delay equal to: 
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[0251] N1 lines, 

[0252] typically 240 lines in digital NTSC, 288 lines in digital PAL or SECAM via a first 
delay element 12. In the figure, this delay is shown diagrammatically by a delay of a 
field, followed by a delay of a line, then of a field. 

[0253] The output of this delay element thus corresponds to the pixel D in FIG. 5. The 
pixels A and D are presented to an absolute difference calculation unit 14, which 
establishes the part |A-D| of the expression M0=max(|A-D|,15/16*M(N)). 

[0254] A first maximum value determination unit 16, which produces at output 16a the 
largest of the two values presented at respective inputs 16b and 16c, collects at one of 
these inputs 16b the output |A-D| of the unit 14 and at the other 16c a value coming from 
a feedback loop from its output 16a. This line introduces the recursive character of the 
motion analysis. More particularly, this line includes a second delay element 18, 
identical to the first 12, the input of which receives the data item M0, present at the 
output 16a of the first maximum value determination unit. The delayed output of an 
image M(N) of the second delay element 18 is presented at input of a gain application 
unit 20 which applies an attenuation factor FA of 15/16 on its algebraic motion value. 
This value thus reduced of M(N) is applied at the second input 16c of the maximum 
value determination unit 16. 

[0255] At the output of the feedback loop, a second maximum value determination unit 
21 produces the value M at its output 21a. This value corresponds to the maximum 
between on the one hand the data item M0 presented at a first input 21 b of this unit and 
the data item coming from a minimum value determination unit 22, present at its second 
input 21c. The minimum value determination unit 22 produces at its output 22a 
whichever of the two data items M(N1) and M(N1+1) presented at respective inputs 22b 
and 22c has the minimum value. The data item M(N1 ) corresponds to the motion 
calculated between the pixels B1 and B in FIG. 5. This arrangement avoids storing the 
field m-2, which would otherwise be necessary to determine this motion value. The data 
item M(N1+1) corresponds to the motion value between C and C1, calculated one line 
earlier. 
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[0256] In this way, the output of the value M corresponds to MO, except if one of the 
values M(N1 ) or M(N1 +1 ) is higher than it, in which case the output M will correspond to 
the lesser of these two values, in accordance with the conditions established above for 
the algorithm. 

[0257] The attenuation factor FA of 15/16, less than 1 , makes it possible to obtain the 
convergence of the algorithm and to produce the dynamic behavior sought. 

[0258] Other values of FA are conceivable according to the applications and 
parameterization of the system. 

[0259] Tests have shown that too great a reduction in the attenuation factor, in other 
words excessive attenuation of the value M(N), can lead to dynamic artifacts. This is 
explained by the fact that when the attenuation factor is reduced, the final M tends to be 
lower and no longer fully matches the detail measurement in the output mixer. Small 
groups of pixels or isolated pixels are then obtained which tend to be interpolated 
temporally, whereas they should be interpolated spatially. 

[0260] It may be noted that the value of M is used for decision-making, and not as a data 
item directly influencing the interpolated value. The convergence time is acceptable, if 
not even desirable. On the one hand, an advantage can be drawn from it, since this time 
period prevents a sudden swing from spatial interpolation to temporal interpolation when 
parts of the image become motionless, which constitutes a major common artifacts with 
mixed temporal and spatial algorithms. For the eye, abrupt changes in clarity are 
perceived as irritating and tiring for its adaptation system. On the other hand, sudden 
changes from temporal interpolation to spatial interpolation are likely to occur when 
parts of the image begin to move. However this choice remains reasonable in order to 
avoid dynamic artifacts, which are perceived as still more unpleasant than abrupt 
changes in definition. 

[0261] In conclusion, the motion measurement proposed is above all dedicated to 
controlling the interpolation selection unit 10 for the system proposed. 

[0262] Switching for output selection between a spatial interpolation and a temporal 
interpretation. 
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[0263] Decision on the luma. 

[0264] The purpose of the interpolation selection unit 10 is to decide, for each pixel, if 
the interpolation produced at the output is to be of the temporal or spatial type. This 
decision is made on the luma. 

[0265] The algorithm gives for the final interpolation on the luma: 
[0266] l=med(s,t+M,t-M) if M<d 
[0267] otherwise l=s. 

[0268] where: I represents the final interpolation 
[0269] s represents the spatial interpolation 
[0270] t represents the temporal interpolation 

[0271] M represents the motion measurement at the position for interpolation, 
[0272] d represents the detail measurement at the position for interpolation and 
[0273] med (a,b,c) represents the median function of a,b,c. 

[0274] This system has the advantage of being very robust in respect of erroneous 
motion detection, especially in the event of fast text scrolling. This is explained by the 
fact that, unlike other adaptive de-interlacing systems working on pixels, the decisions 
depend not only on motion estimation, but also on the reliability of the spatial 
interpolation. 

[0275] Behavior of the interpolation selection unit in respect of the chroma. 

[0276] For the chroma pixels, in a rigorous way, the preceding formula cannot be 
applied directly to the chroma. The intention in fact is that the chroma should follow the 
decision made for the closest luma, at each pixel position. 

[0277] If the final luma interpolation is considered, it will be noted that it can always be 
written by the expression: 
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[0278] l=a(d,M)n+(1-a(d,M)*s, with a(d,M) between 0 and 1. 

[0279] One possibility would be to calculate the value of a for each pixel and to apply 
this value to the interpolation of the chroma. 

[0280] However that is relatively expensive in terms of system resources, since it 
requires a divider. Furthermore, nor is the value of a in the formula for the luma 
calculated very accurately outside the limit conditions 

[0281]a(d,M)=1 for M=0 

[0282] a(d,M)=0 for M>d. 

[0283] In fact, the parameters (t-M) or (t+M) are simple values easy to calculate between 
the temporal and spatial interpolations. 

[0284] Therefore, for the chroma, the following criteria are established in order to 
determine if the interpolation used at the output should tend to be spatial or temporal: 

[0285] - if the final value of the interpolation for the luma is closest to that of the spatial 
interpolation, spatial interpolation is selected for the chroma; 

[0286] - if the final value of the interpolation for the luma is closest to that of the temporal 
interpolation, temporal interpolation is selected for the chroma; 

[0287] - if the final value of the interpolation for the luma is exactly the mean of the two 
interpolations, spatial interpolation is selected for the chroma, which is the safest. 

[0288] As an alternative, the luma formula may be applied with a slight loss of 
performance and spatial interpolation can also be used systematically for the chroma, 
which allows the field memory capacity required for temporal interpolation to be 
reduced, with a loss of performance on the chroma. 

[0289] Initialization. 

[0290] Launching the sequence. 
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[0291] The system operates with a delay of a field on account of the temporal 
interpolation and the motion calculation. As a result of this delay, fields 1 and 2 are 
available for the reconstruction of field 1 . 

[0292] At the beginning of the sequence, the motion MO is initialized at 0. 

[0293] For the temporal interpolation of field 1 , the information about the previous field is 
not available. Instead of this missing information, the first available information is used. 
As is shown in FIG. 5, the parameter D is replaced by A, which gives a temporal 
interpolation equal to A. Then, the initial corresponding motion is 0, giving rise to a pure 
temporal interpolation for the first field (in fact a field fusion). 

[0294] For the interpolation of field 2, the temporal interpolation can be carried out 
normally. The motion will go to |A-D|. This means that the dynamic artifacts likely to 
occur in respect of the interpolation of field 1 will already have almost disappeared from 
the interpolation of field 2. The existence of a field with the wrong interpolation at the 
outset is barely conceivable. 

[0295] Edges of the image 

[0296] First luma line of the even-numbered field. 

[0297] The first line for the spatial interpolation of the even-numbered field is line 1 . In 
order to interpolate this line, the information about the line above is not available. It is 
proposed instead to use the information from the first available line, in other words that 
in line 2. This means that the spatial interpolation of line 1 becomes equal to that of line 
2, since the best direction for the interpolation will necessarily be the vertical direction 
(SAD (0) = 0. 

[0298] The detail measurement will then be at 0 for the whole line. 

[0299] In respect of motion detection, the missing information C and C1 is also replaced 
by B and B1 . If the motion is equal to 0, the attenuator will select temporal interpolation; 
otherwise it will select spatial interpolation. 

[0300] Last luma line of the odd-numbered field. 
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[0301] In the same way, in respect of spatial interpolation of the last line of the odd- 
numbered field, in the event of N being even-numbered, the information from the line 
below is missing. It is proposed to use instead information from the last available line, in 
other words the line N-1 if the total number of lines is N lines per frame (even-numbered 
N). The last line subject to spatial interpolation is equal to the line N-1 . 

[0302] First and last chroma lines. 

[0303] In the event of a 4:2:2 chroma, the same principle can be adopted as for the 
luma. This means that use is made of the information from the first available line at the 
beginning of the even-numbered field and the last line available at the end of the odd- 
numbered field. 

[0304] In the event of a 4:2:0 chroma, the information is not available in respect of the 
interpolation of line 1 of the even-numbered fields and of the line (N-1), this in the odd- 
numbered field if N is a multiple of 4, or in the even-numbered field if N is not a multiple 
of 4. For the interpolation of the line 1 in the even-numbered field, it is known that the 
spatial interpolation of the luma will be in the vertical direction. Therefore, for the 
interpolation of the chroma, the first chroma information available can be used in order 
to replace the missing information; this leads to an interpolated line 1 equal to the 
original line 3. For the line (N-1 ), the direction of the interpolation calculated from the 
luma is not always vertical. In order to follow on the decision on the chroma, we have: 

[0305] if min (SAD)=SAD(0) then UVs=UV(N-3,k) 

[0306] if min (SAD)=SAD(1 ) then UVs=(UV(N-3,k)+UV(N-3,k+2))/2 

[0307] if min (SAD)=SAD(2) then UVs=UV(N-3,k+2) 

[0308] if min (SAD)=SAD(3) then UVs=UV(N-3,k+4) 

[0309] if min (SAD)=SAD(-1) then UVs=(UV(N-3,k-2)+UV(N-3,k))/2) 

[0310] if min (SAD)=SAD(-2) then UVs=UV(N-3,k-2) 

[031 1] if min (SAD)=SAD(-3) then UVs1=UV(N-3,k-4) 
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[0312] In conclusion, the interpolation of the first or last lines can be carried out by 
replacing the missing pixels with pixels that are symmetrical relative to the position 
subject to interpolation. 

[031 3] First and last pixels of a line. 

[0314] For a pixel position at k<2, the whole window cannot be defined for directional 
spatial interpolation. 

[0315] This problem can be resolved by replacing the missing pixels by the first available 
pixel in order to calculate the SAD and to calculate the interpolated value. The 
correspondences: 

[0316] K=0=> vertical 

[0317] K=±1 => ±26° 

[0318] K=±2 => ±45° 

[0319] K=±3 => ±63° 

[0320] are no longer respected, but the minimum SAD will still correspond to the best 
objective direction for the interpolation. 

[0321] The same initialization is made for the chroma pixels in the odd-numbered 
columns: any missing pixel in the interpolation formula is replaced by the first available 
pixel. 

[0322] For example, for the first pixel on the left (k= 1), the calculation is: 
[0323] SAD(0)=0.875*|Y(n-1,1)-Y(n+^^ 

[0324] SAD(1 )=0.5*|Y(n-1 ,1 )-Y(n-1 ,1 )|+0.31 25*|Y(n-1 ,2)-Y(n+1 , 1 )+0.1 875*|Y(n-1 ,3)- 
Y(n+1,2)| 

[0325] SAD(2)=0.31 25*|Y(n-1 ,1 )-Y(n+1 ,1 )|+0.375*|Y(n-1 ,2)-Y(n+1 ,1 )|+0.3125*|Y(n-1 ,3)- 
Y(n+1,1)| 
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[0326] SAD(3)=|Y(n-1 ,3)-Y(n+1 ,1 )| 



[0327] SAD(-1 )=0.5*|Y(n+1 ,1 )-Y(n-1 ,1 )|+0.3125*|Y(n+1 ,2)-Y(n-1 ,1 )|+0.1 875*|Y(n+1 ,3)- 
Y(n-1,2)| 

[0328] SAD(-2)=0.3125*|Y(n+1,1)-Y(n-1,1)|+0.375*|Y(n+1,2)-Y(n- 
1 ,1 )|+0.3125*|Y(n+1 ,3)-Y(n-1 ,2)| 

[0329] SAD(-3)=|Y(n+1 ,3)-Y(n-1 ,1 )|. 

[0330] If min(SAD)=SAD(-3) then Ys1 =(Y(n-1 ,1 )+Y(n+1 ,3))/2. 
[0331] Finally Ys is given by: 

[0332] Ys=Ys1 if Ys1 is between Y(n-1 ,1 ) and Y(n+1 ,1 ) 
[0333] otherwise Ys=(Y(n-1 ,1 )+Y(n+1 ,1 ))/2 
[0334] With the chroma UVs1=(UV(n-1 ,1 )+UV(n+1 ,3))/2. 
[0335] Finally, UVs is given by: 

[0336] UVs=UVs1 if UVs1 is between UV(n-1,1) and UV(n+1,1) 
[0337] otherwise UVs=(UV(n-1 ,1 ) +UV(n+1 ,1 ))/2. 

[0338] The same principle is applied for the last pixels of the line: the missing pixels are 
replaced by the last available pixel of the line. 

[0339] The performance of the different algorithms proposed has been subjected to tests 
on various sequences. It has emerged from this that relative to other de-interlacing 
systems, the algorithm proposed brings remarkable improvements particularly to 
sensitive elements such as logos, static or scrolling text, and to the clarity of motion 
transitions. 

[0340] The system according to the invention operates correctly even with images 
coming from a film medium and it does so without film detection. 
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[0341] Film detection is necessary in most de-interlacing systems so as to avoid losses 
of resolution when the image comes from film stock. 

[0342] In the system according to the invention, when the images are extracted from a 
film medium the following circumstances may be distinguished: 

[0343] - in the static parts, the attenuator tends towards a completely temporal 
interpolation, equivalent to a local fusion of the two fields, equivalent to the conventional 
de-interlacing of film stock; 

[0344] - in the parts of details in motion, advantage is taken of directional interpolation 
which gives results still very close to those of a fusion of the two fields for the film stock. 
The system capitalizes to advantage on the fact that the eye can identify above all the 
limitations of objects in the parts of an image in motion. 

[0345] Sophisticated vector-based motion compensation systems allow a slightly better 
reproduction of details in movement, but are much more expensive and suffer from the 
weaknesses of de-interlacing systems that require a film detection. 

[0346] Although a specific embodiment of the invention has been disclosed, it will be 
understood by those having skill in the art that changes can be made to this specific 
embodiment without departing from the spirit and scope of the invention. The scope of 
the invention is not to be restricted, therefore, to the specific embodiment, and it is 
intended that the appended claims cover any and all such applications, modifications, 
and embodiments within the scope of the present invention. 

[0347] What is claimed is: 
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